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SYSTEM FOR ENABLING SELP-MONITORIHG 
BACKGROUND OF THE INVENTION 
The invention relates to . system for enabling 
5 self-monxtoring, with regard to body movement sequences 
to be carried out, by the moving person. 

Practicing specific movements or movement 
sequences plays an important part for example in the 
context of rehabilitation. In this case, the subject or 
10 patient practises specific movement sequences in order 
to train his/her overall body mobility or 
alternatively, in order, for example, to influence 
specific body parts or muscle groups in a targeted 
manner. However, the targeted practicing of specific 
15 movement sequences is also an important therapeutic 
element for physically disabled persons. when 
practicing these movement sequences or when carrying 
out the training exercises, it is often crucial that 
the movements be performed "correctly", that is to say 
that a predetermined movement sequence be adhered to in 
the best possible manner. It would be desirable here to 
identify deviations, to the extent possible, in the 
course of the movement, in order to be able to 
immediately correct them and thereby avoiding the 
.5 situation Where an exercise is repeatedly carried out 
incorrectly" which cannot lead to the therapeutic 
success sought. On the contrary, in this case there is 
even the risk that, on account of the "incorrect" 
movement sequence, there will be no improvement at all, 
or even a deterioration. 

Self-perception of a subject's own movements is 
often insufficient for adequate monitoring. One reason 
for this is that self-perception can be disturbed, for 
example on account of specific disturbances to the 
35 subject's health. it is, furthermore, often not 
possible for one to visually observe his or her 
movements which may require a rear view or side view 
Finally, when carrying out a complex, dynamic 
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procedure, self-perception nay be overtaxed. i„ other 
words, the patient cannot simultaneously concentrate 
both on correctly carrying out the con^lex movexnent 
sequence and on detecting any .ove„.ent errors. i. 
5 order to remedy this, it would be possible to enlist an 
external observer, .uch as a trainer or therapist 

Furthermore, .t is possible to utilize mirrors and the 
10 in self-observation. The disadvantage 

xn thxs case is that, in spite of everything, the 
actual .deal body position or the ideal movemn 
sequence cannot be identified. In other words, 
adequate monitoring cannot be achieved by this mean: 
either Finally, there also remains the possibility of 
capturing the movement sequence by means of a video 
recording and subsequent observation and analysis 
However, real time self -monitoring during movement is 
not possible in this case either. 

EP 0 700 694 Al discloses a training and diagnosis 
method m which the person who is training has to carry 
out a movement using a training device. a measurement 
recording xs made and used to detect movement. The 
recording is displayed in the form of a curve 
representing the movement course. The recording is 
displayed on a monitor. With respect to the curve, it 
IS possible to insert a predetermined curve to be 
reconstructed by the person who is training. 

WO 98/28053 describes a device for carrying out 
interactive movement training in which optimum movement 
sequences are stored in a memory, while the exercises 
^re being carried out, a video camera captures an image 
of the person who is training. The image is superposed 
on the stored video sequences. The person who is 
exercising simultaneously sees himself and the optimum 
movement sequence on a monitor and can compensate for 
any deviations. What i. disadvantageous here, however, 
IS that the person who is training has to adapt the 
3peed at which he performs an exercise to the speed at 
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Which the Video aaguence ia reproduced. The 
reproduction speed is, however, adjustable 

oositi' ''T''' ^^^"^^''^ -^-'^ the 

position Of a golf player is recorded by a video 

5 ca^ra. a video recording of an opti^u. „.vex„ent 
sequence .s si„.ultaneou3ly displayed on a monitor. 
There as, however, no interactivity between the 
recorded movement and the real movement. 

A system for the insertion of an optimum 
10 trajectory, in a game of basketball, by a laser beaT 
xs disclosed in US 5,365,427. However, the targeted 
training and monitoring of individual movement 



sequences is not possible in this way. 
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SUMMARY OF THE INVENTION 
The present invention is thus based on the problem 
of specifying a system of the type mentioned in the 
introduction which avoids the disadvantages mentioned 

In order to solve this problem, a system of the 
type mentioned in the introduction is provided, 
according to the invention, comprising: a video camera 
-nd a monitor for outputting the recorded video image - 

25 TntjT" ''''' at least one moving marker 

indicating a predetermined movement or body position, 
the marker being inserted into the video image, the 
insertion means being designed for detecting 
Characteristic points, lines, contours or the like of 
the person who is performing a movement sequence and is 

30 shown m a recorded video image sequence, or of the 
person's area shown, and for automatically adapting the 

speed of the moving person, or of the person's area. 

on the one hand, the system according to the 
35 present invention utili.es the possibility whereby 
images that have been captured by means of the video 
camera can be reproduced "live" on the monitor, so that 
the person can follow the movement sequence directly on 



Received irom< 441 585 583 228 > at 2126/03 3:32:37 AM [Eastern Standard Time] 



26. FEB. 2003 9:31 ^WENS SCHWEIZ +41 585 583 228 NR. 842 S. 21/32 



199eP03666WQUS 
Thomas BirichalsQr 



20 



25 



30 



35 



iMl=atlng the ideal body position with regard to th= 
n»v«»„t «q„e„c, predetennlned by, for ."aJ. 

~~=e"ii:rr " ^^^-^-^^^ 

> With the curt" Ituai Isit- "° 

"hioh he r 1" "hich he le in and 

In ? °° T". subject 

indic , . I "-iations fro. the desired position 

colct th!! "IT Wdietii; 
correct than. This enables the subject to identify and 

ZllZ r Je—eTrth =° 

actually be ^ach • L f^rT"' T""^ 

possible to insert, by way of „alie ' 

r.^nT,4.* ^ example, one or more 

ziiLr^'''"".' ^° t bod" 

extremities, and also one or a plurality of lines in 
particular in the form of a styLzad 
("-tch.tic. man", or, alternatively, in the fo'I^If 
contour lines and the like Tho 

between th*.» J "^^"^ '^^'^ ^^^oose 

f o^ h depending on which display 

form he personally prefers for self-monitoring. iZ 
movements to be carried out and the position of th! 
»ar.ers are stipulated by the trainer or tjlist 
according to e.g. medical standpoints. ^^-^-P^^t 
The insertion means is designed for inserting . 
moving marker indicating a predetermined, rdeaiJod; 
movement. The marker moves in parallel with and at the 
same time as the body. m other words, the subieL L 

: ::: T:::r ""^^ -'ever;";:::n; 

wnioh he can compare with the actual position in 
acccrdance with his own video i^,e. This L e:^p.dient 
"hen .t is Important not only to attain a specifL body 
position, a, in the case described above, but also for 
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the body movement to follow an ^r^^^i ^ 

dirsotlon. " »ov«,«„c li„e or 

If the spMd of the movement is not important in 
specific move,„ent «,u.n=.., for exan^l. i„^,, of 

lint "i™"' ""'""'^ ch,r.cteri.ti: 

n oer'f " '"^ WO 

IS perform:Lng e move,n.nt sequence and is shown in » 

recorded video image sequence, or of th. person" , ares 
10 Shown, can be designed for sutomatically adapting the 
™t speed Of a Moving marker to the 'movement 'sp ed 
of the moving person or of the person's area 

to th?\r"/ """" «»' "cording 

to the invention, be directly integrated in the video 
15 camera. t„ video cameras, the insertion of graphi" 

llZ r ""^ °' " --1=^' 'the 

video i^ge, IS a known standard function with which 

^.g. the time or date can be inserted as te« into the 

video film. The means, a graphics processor, which is 

camera, merely has to be configured or programmed in 
accordance with the marker to be inserted in the case 

invention. »s an 

2S the 1 ' It " " ^"egrat. 

1' r '. " '° 9"^"^" processor, 

inseli " " '° - i»terpose; 

insertion means, for example in th. form of a personal 

ItZll'' T'" """'^^ " «nLtion 

30 (e.g. a communications line). 

can '"e insertion means 

can also be designed for inserting a marker which is 
stationary during the body movement. In other words, in 
J5 '""-tive, during the body 

the right leg are to be simultaneously swung into a 
specific position, the ideal end positions to be taken 
up respectively by the arm and leg are indicated In 
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this case, the subject recognizes whether he is now 
actually swinging his ar. or his leg to an extent .uch 
that he attaining the therapeutically ideal desired 

5 IZX:' ^"'^^ - ^- 

As described, the marker or markers serves or 
ot\'r! '"'/"^"^'^'^^ - desired body position. r„ 

other words, the position or .i.e and the like of the 

10 Zl ^° -d 

"po3.txon and size" of the person shown in the 
xmage depends, on the one hand, on the si^e of the 
person himself /herself and, on the other hand, on the 

15 fr^"^. °" ^^^^^^-^ thereof 

fron. the person. Moreover on whether, by way of 

example, only a specific body area is to be displayed, 
for example only a leg which is to be moved in , 
targeted manner, and which is then moved into the video 
image using a zoom device of the video camera. 
20 TO provide a simple possibility ensuring that the 

person xs correctly positioned with respect to th^ 
vxdeo camera, in order that, with respect to the person 
3hown the video image, the markers are inserted at 

shown °r'?. °" '''' the person 

shown m the xmage, according to the invention it is 
possible to insert one or more markers which serve as 

adDUfitment markers and, bv wav of ^« , 

'=>y way of example, specify 

like must be positioned in the video image. The person 
Who .s tra.n.ng then merely has to choose his position 
wxth respect to the video cameras such that his head 
and feet and the like are congruent with the adjustment 
markers inserted into the video image, m addition to 
these markers serving for adjustment, the further 
markers indicating the movement or body position to be 

Who xs training must maintain a fixed position with 
respect to the video camera. 
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correlation, according to the invention, the insertion 
»ean« can be designed for detecting k 
point,, ll„ee, contours or J uTof ".""""'^"^^ 
S person sho«. i„ recorded vidt LT oTr™' 
pers , auton^tlorir-edspti:: Z 

position, in a manner dependent on the 

10 the Vd" "° t* 

"th":jrd LTnr '° '"T '"^ infor^tlcn 
.» ! person -s area 

whsti..„.., oar;herj''rr::dttt%:r:; 

Iso -patiently done w^n the 

to aetect said person's char.cteristic points 

insertion"" " i, pc^i^i^ 

insertion means to h» 

20 Characteristic points line. V ! " "''"""^ 

*w points, lines, contours or the like of 

the pe.3on who is perfor.i„, a movement sequence an. as 
shown xn a recorded video ixaage sequence, or of the 
Lrtr -to^atioany adapting th! 

d.^o-.^r ^ 'nanner dependent on the 

detection result in » *j 

csuj-t. in this configuration of fh» 

invention, therefore, firstly a . 

) Zect pr.rs^th"'''"'''""' - 

noject performs the moven«nt in the best possible „av 

recooni " "*° " the sa»e ti j tc 

that \: " " «». - 

that. If appropriate, in addition to the .„ton,l* 

le^"::::.";!,":""" - -."r 

representation sequence of the mark^^ w u 

turr/'in^r-- — ^ -re".rtr„.'^: 

uuis way, m the manner of a "teaeh-t n" *u 
»ove„ent specification, that is tV^t; the rs.r\t: 
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therapist can thus gensrat, Vh. °' 
by the mar Jr,sT. '"P"*"- subject, defined 

If the speed of the movement is not i>™->» ^ . 
specific movement sequences, for e,lple LT 
P^wer training ^'^f ^ -J'- of 

" p^r^-i"-- rrre-rlett 

re^r; a~ t"s:rra:: :r r - 

recorded video i„a,e sequence! or^o/te ert^s ^rel 

of Z „ ^ """^"^ movement speed 

of the moving person or of ths r,.,. i 

described, in addition tf attom^'r^sdap^rtio:; 
variation, ^„„al variability of the sl.e and/or of th, 

20 marker may also be provided. i- o or the 

in..,^!' ° "-"juration of the invention, the 

insertion means may be a»e,-„n.j 

which f„v = , , ^'SiShed a storage means in 

lov^lnt of -ilfferent predetermined body 

movement seguences, the respective insertion data of at 
25 least one marker is stored and can be selected bv tL 
user as desired. This enables a subject llo T 
content of his rehabilitation or training, has'to carr: 

aelec: the"?? °' -guence to 

select the marker sequence ini-*:.hH*w 

30 ™nt sequence, 30 t^t t ^t J.t. . ^^^"^"'^^ 
displayed. sequence ig 



BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE V^m^S 

35 Further advantages, features and details of th 

invention emerge from i-ho , °^ 

described below Ind ffol th ^ ^^^"^^^^^V en^bodiznent 
Fia»r« 1 r ^ drawings, in which: 

Figure 1 Shows a system of a first en^odiment, 
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Figure 3 3hc». a system of a third a»bodtnent. 

5 

DETAILED DESCRlPriON OF THE INVENTION 

vld.o''''' -'=-ording to the invention comprises a 

video camera 1, which is used to record i-h ^^^^^^ 

^^eccrded .dL Z^71 : ^-1^^ 

~atr: — .UL- ----- 

5 is connected between videJ ca^^^a 1 end"''" "'^"^ 
15 The insertion means 5 serves fTr L T 

shov/n video image 4 at ZlZ ^'^^^"^"^ ^^to the 

ideal desired h H '""''^^ indicating an 

^aeai desired body position v,hich should ideallv h» 
taken up by the person 2 who is carrying out a specif^ 
movement sequence. m the examr.!. ''"^ ^ specxfic 

20 of markers s Ht, * example shown, a plurality 

th.^iH ''^ ^^^"^^ inserted into 

the video image 4. These points 6 can 

visually by the person 2 m th. , ^^^'^^^^^^^ 

markers 6 are assianed . I. 

TWO markers 6 ar ^ extremities. 

25 markers a/e assi '° additional 

depict:drrk:rsre\rsi::/r^/;i^^^ - 

coincidence or non-coincidence of the J " 

the respective body parts of the person iTlJ T 

imaafs 4 H-u H«t3on i£ m the video 

30 er ' . d^ rXc^ "° « 

^oay position Corresponds tn ^ . 

position pr.d«er.i„.d tha J.^.t T t" 

r: it:r" "r- '-^ -^^-^ - 

- HO Jar" r opacification, 
the daairad ^=.u,o„ i„ca t a a!"", ' 

Video , co„9r„.„t with tha a/. 

6' rpw assigned marker 

Th. parson 2 can in^diataiy racogni.a thia 
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deviation from the desired position, durina th« 
movement, and than correct it accordingly, 30 t.at the 
subsequent movement sequence can be carried out 
manner approximated even further to th - ' 
5 position, iurrner to the desired 

/*. integrated in the video 

^^^« 2,, alternatively i„ th. ,»„it„. ^n^:™? 

In each case thp* m-aaps^ . \-^-*-gure j) . 

10 designed /ralir ^-^J'-^-es an appropriately 

u^ssignea graphics processor which r^r^ . 

figure 2 shows stationary markers 7-1',. 
into the Video image a„T se4 Tr 
poaitionin, o. the person .itl .^ , 'to'^tr'-/' 
IS camera 1. The nar-.,^ v 'aspect to the video 

«=p.=t to v^nrT^r T":"/"- 

f^f.f ^-K Lintix e.g, the head and 

::aVrr jra%:"*° ~ 

be able to hI^ ' furthermore 

-..eriauo .t::::: .::ti ottor- tretera^- 

sho»„ rro. this it is possible to i^entily the si I" 

^rker / """""""-^-'l^ ^-^apt the insertion o("he 

Video f„ " P^^™ in the 

Video «age were, for exa^l,, represented only half L 
large, for example if the v<h=» " 
30 >(• . • e 11 the video camera 1 were arranaed 

tt/e :r~g,nrr " 

cnange to the insertion positions of 

xni5 adaptation can be faf^^o,-4-«^ 
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In addition^ instead of ^oi- -i^r «^ 
addition to) the .ntarJt, . appropriate, in 

position and/or si.r rr ^'^^^^^'-^ ^.,er 

. ' ^® possible (as described with 

for 2 . " '° '"""^ stationary markers serving 

for positioning e.g. the head and feet of the person 
and for adjustment, in this case i-h. Person, 

4.^ ^"^^ case, the person only has 

to position himself/herself relative to the vide! 
camera in such a way that i-h« ^ u 

10 linage and the f^. ! ^i'^^o 
•unage and the feet are congruent with th^ 
markers r*, respective 

taken-up position during the exercise 

Furthermore, the insertion means is designed fo. 
inserting stationary marker., which only defiTideal 
T, r'^""" °' i""tinTm.rk::s 

IteTateoiT " " ^= ^orZT" 

aanere to a Specific movement speed during 

sequence that is carried out, the in "' t """"""^ 
furthermore abi. to adaot th. ^ " 

20 markers S 1„ . 7 movement spe.d of the 

per." in Z'"""" Of th. 

Lptauon'is'e^erd ^en^trp'e's '"^^ 

a-rt' rier-":: ~"rth: ::--o:: 

addition to the embodiment of the markers 6 L the fo^ 

30 like Tin/li "-an") or the 

aisLed " = also be 

Which the '"r^"^^""^ integrated storage means in 

wnicn the insertion dAt-A , 

movement sequences toTe c ciifferent 
stored, and whiC can 1"^ ^"^^^^^ 
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1. A system for enabling s,el£-™»„it„ri„g, with reaard 
to body crried out bv tb. 

= mo„n, p.„on, oo^prl.ing . video oan.« a I, 

" boiy positL^ i;" 'tL^'t'r'^"^^ ~" 

10 oharaoterized 1„ that th, . 

deslTn.^ , . insertion means (5) i, 

designed for detecting characteristic points iLe^ 

contours or the like of n,. _ Pomts, li„es, 

P-rfor^ng a ^t' at ten!' Zls IL;"! 

»o.„g peraon f.,, rof'::h;uiTra'. 

inaerting a ,«rker ,S) „hioh is "tat t,""^" 

body „ove^„t and indicates a pr.deter„V/ 

movement. P^eaetermined, ideal bpdy 



25 3. The system as clain,ed in claim 1 . . 

characterized in that i-hc ^' 

in tnat the means is deainno.^ # 

inserting at least on^ =4- *. • aesigned for 

^. stationary marker (6") serving 
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4- The system as claimed in one of i-u 

claims, characterized in that thn ^'^^^"''^"^ 

.3 designed .or detectin; Tr^. ::::tL::'r. 

Ln:rr:' ^ "™.g^rr 

in the recorded video image (4), or of i-h. 

area shown anrf / or of the person's 

^^^^ Shown, and for automatically adapting the marker 
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in particular the letter's si:.* . ^/ 
position In = and/or insertion 

result """" '^^^"'^"^ - detection 

' 5 The system as claimed in one of the precedina 
cla.»3 Characterized in that the insertion Ta.s 5, 
X. designed for detecting characteristic points alnis 
contours or the Ilk*. *u pomes, lines, 

r, ^ . ^ person (2) who is 

Perforrning a ntove«»ent sequence a„d is shown ■ 
recorded video i:„age sequence, or of the persons are! 
Shown and for automatically adapting the JarL 

posit'rt'a''^ '"""^ ''^^ 

result """" '^^^"'^^"^ - ^'^^ detection 

6. The system as claimed in one «f ^v, 

claims, characterized in that th Preceding 

V. The system as claimed in one a£ rh^ 

claims, characterized in that the in . P^^^-^ing 

is as«5j«n«ri ^ insertion means (5) 
IS assigned a storage means in wh-i^k * 

,tor.d and nan be ,al.ct.d by the u,« as de=i«d. 



8. The eyatem as olairoed in one of i-h» 
cUi«.. Characterised in that a point, 11^ ' 
particular in the form of a ,f„n. f ' 
c.n be diaplayed as Z LL^Z °' '"^ "•=^ 

It di«:«Td" f":" ^" ^''"-teri.ed in 

35 user are pr:;.::^''^^ '"^ ^'o-" by the 
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10 The systen. as cl.ixned in one of the preceding 
claoms, characterized in that the insertion means (5) 
is integrated in the video camera (i) . 

11. The system as claiined in one of claims 1 to 9, 
characterized in that the insertion means (5) i 
integrated in the monitor (3) . 

12. The system as claimed in one of claims 1 to 9 

ZZIT'^" '''' '^'^'''^-^ is 

arranged as a separate element within the 

communications connection between the video camera (i) 
and the monitor (3) . 
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